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Abstract 

An algorithm for measurement of entropy in multiparticle systems, 
based on the recently published proposal of the present authors J2|, 
is given. Dependence on discretization of the system and effects of 
multiparticle correlations are discussed in some detail. 

It was suggested recently |I| that studying event-by-event fluctuations 
may be used for determination of entropy of multiparticle systems created in 
high-energy collisions. A generalization of this idea and a specific proposal 
for measurement of entropy were formulated in 0. In the present note 
we spell out explicitly the steps to be taken to implement effectively the 
method proposed in ||. Importance of the dependence of measurements on 
discretization of particle momenta and the role of (multi)particle correlations 
are emphasized. 

1. Selection of the phase-space region. 

As the first step in the process of measurement one has to select a phase- 
space region in which measurements are to be performed. This of course 
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depends on the detector acceptance as well as on the physics one wants 
to investigate. The region cannot be too large because for large systems 
the method is difficult to apply (the requirements on statistics become too 
demanding). With the statistics of 10 6 events, the region containing (on 
the average) ~ 100 or less particles should be possible to investigate. A 
reasonable procedure seems to be to start from a small region and then 
increase it until the errors become unbearable. 

Comment 1: The proposed measurement is not restricted to systems with 
very large number of particles. It can be applied to any multiparticle system, 
e.g., in e + e~ annihilation, hadron-hadron collisions or peripheral nucleus- 
nucleus collisions. 

2. Discretization of the spectrum. 

The selected phase-space region should now be divided into bins of equal 
size in momentum space. The number of bins cannot be too large if one 
wants to keep errors under control. On the other hand, as argued below, it 
is important to study the dependence of results on the size (and thus the 
number) of the bins. Therefore, large statistics is essential for a success of 
the measurement. 

Comment 2: If one chooses the bins which are not of equal size in mo- 
mentum space, the original expression for entropy requires a correction which 
follows from an appropriate change of variables . This correction is, in gen- 
eral, not easy to calculate. Nevertheless it may be interesting to study the 
dependence on the shape of the binning, as well. 

3. Description of an event. 

Using this procedure, an event is characterized by the number of particles 
in each bin, i.e. by a set of integer numbers s = mp , where i — 1, ...M (M 
is the total number of bins) and the superscript (j) runs over all kinds of 
particles present in the final state. These sets represent different states of 
the multiparticle system which were realized in a given experiment. The 
number of possible different sets is, generally, very large (for 5 bins and 
100 particles one obtains ~ 10 6 sets). This is, in fact, the main difficulty 
in application of the proposed method. It simply reflects the fact that the 
system we are dealing with has very many states. 

Comment 3: It should be realized that, in practice, such a description is 
never complete, i.e., it never describes fully the event. Most often some of the 
variables are summed over. This is the case, e.g., when one measures only 
charged particles. Then all the variables (i.e. multiplicities and momenta) 
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related to neutral particles are summed over. It may be thus interesting to 
study reduced events, when even some of the measured variables (e.g. particle 
identity) are summed over (i.e. ignored). 

4. Measurement of coincidence probabilities. 

As explained in || , this is the basis of the method and therefore the most 
important step in the whole procedure. 

The measurement consists of the simple counting how many times (n s ) 
any given set s appears in the whole sample of events^. Once the numbers 
n s are known for all sets, one forms the sums: 

N k = ^2n a (n a -l)...{n a -k + l), (1) 

s 

with k = 1,2,3,.... The sum formally runs over all sets s recorded in a 
given experiment, but nonvanishing contributions give only those which were 
recorded at least k times. One sees that N k is the total number of observed 
coincidences of k configurations. The coincidence probability of k configura- 
tions is thus given by 

k N(N -1)...(N -k + iy y ' 

where N is the total number of the events in the sample!. 

One sees that N*. given by ([!]) are simply factorial moments of the distri- 
bution of n s @. It is also clear that, since J2 s n s — N, C\ = 1. Finally, one 
sees that only states with n s > k contribute to N k (and thus also to Ck)- 

5. Errors. 

The error of Ck is determined by the error of the numerator in (Q). This 
error can be estimated by standard methods used in evaluation of the mo- 
ments of a distribution. 

6. Renyi entropies and Shannon entropy. 

Once the coincidence probabilities Ck (k = 1,2,...) are measured, it is 
convenient to calculate the Renyi entropies defined by J| 

B„ - (3) 



1 Since the number of different sets is very large, most of them shall appear only once 
or not at all. 

2 As explained in Q this ratio is equal to the (k — l)-th moment of the probability 
distribution Ck = ^2 s (Ps) k - The proof follows closely the argument of S. 
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The Shannon entropy S (i.e. the standard statistical entropy) is formally 
equal to the limit of Hk as k — > 1 and thus can only be obtained by ex- 
trapolation from a series of measured values: Hk = H 2 ,H 3 ,.... to k = 1 
i. Of course such an extrapolation procedure is not unique and introduces 
uncertainty. The main point is, as usual, to choose the "best" extrapolation 
formula, i.e. the functional dependence of on k which will be used to 
reach the point k = 1 from the measured points k — 2,3, .... This form can 
only be guessed on the basis of physics arguments (or prejudicies). 
In it was suggested to use 

H k = a^^ + a + a 1 (k-l) + a 2 (k-l) 2 + .... , (4) 

where the number of terms is determined by the number of measured Renyi 
entropies. This formula turned out to be very effective in reproducing the 
correct value of entropy for some typical distributions encountered in high- 
energy collisions. 

Another possibility is to use 

Hk = a + di/k + a 2 /k 2 + .... (5) 

suggested by the formula for the free gas of massless bosons^. 

It will be interesting to compare the results from these two formulae. 

Comment 4: The measured values of the Renyi entropies give valuable 
information about the system and thus are of great interest, independently 
of the accuracy of the extrapolation. 

7. Dependence on discretization; Scaling. 

As the result of the procedure explained in Sections 1 to 6, we obtain the 
Renyi entropies Hk, (k=2,3,...) and the Shannon entropy S of a given phase- 
space region. These entropies still depend on the method of discretization 
of the momentum spectrum, in particular on the size of the binning. If the 
bins are small enough and if the system is close to thermal equilibrium (i.e. 
if fluctuations are small), one expects the following scaling law to hold 

H k {lM) = H k (M) + log/ -> S{IM) = S(M) + log/ (6) 



3 Obviously, one cannot just put k = 1 in the formula (j^) for that purpose: since C\ = 1, 
the R.H.S. of (||) for fc = 1 represents the undefined symbol 0/0. 

4 For the free gas of massless bosons the Renyi entropies are given by Hk = (1 + 1/fc + 
1/fc 2 + l/fc 3 )Sy4 where S is the Shannon entropy. 
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(M and IM are numbers of bins in two different discretizations). If the scaling 
law is verified, one can determine the part of entropy which is independent 
of binning. 

The rule @ is not expected to hold if the system is far from thermal 
equilibrium and the fluctuations of the particle distribution are large. In 
particular, the effects of intermittency || and erraticity || as implied, e.g., 
by a cascading mechanism of particle production are expected to violate ©. 
Thus testing the dependence of entropies on the number of bins may reveal 
interesting features of the system. 

8. Comparison of different regions; Additivity. 
Measurements of the entropies H k and S, as described above, can be 

performed independently (and - in fact- simultaneously) in different phase- 
space regions. The results should give information on the entropy density and 
its possible dependence on the position in phase-space (e.g., it seems likely 
that the results in the central rapidity region may be rather different from 
those in the projectile or target fragmentation). Furthermore, it is important 
to verify to what an extent the obtained entropies are additive, i.e., whether 
the entropies measured in a region R which is the sum of two regions Ri and 
i?2 satisfy 

Hk{R) = H k (Ri) + H k (R 2 ) - S(R) = S(R 1 ) + S(R 2 ). (7) 

Eq. (0) should be satisfied if there are no strong correlations between the 
particles belonging to the regions Ri and R 2 . Thus verification of (0) gives 
information about the correlations between different phase-space regions. 

Comment 5: It may be worth to point out that the scaling law @ and 
the additivity (0) can be more precisely tested for Renyi entropies (H k ) than 
for the Shannon entropy (5*) where the extrapolation procedure (described 
in Section 6) introduces always an additional uncertainty. 

9. Conclusions 

In conclusion, one sees that the measurement of entropy in limited regions 
of phase-space is feasible. Moreover, even the simplest tests of the general 
scaling and additivity rules can provide essential information on fluctuations 
and on correlations in the system. It should be emphasized that for these tests 
the Renyi entropies turn out to be more useful than the standard Shannon 
entropy. 
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